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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 
All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to 3/16/07 . 

2. ^ The allowed claim(s) is/are 22-43 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 
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EXAMINER'S AMENDMENT 

An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1.312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with Namsoon Jung on 3/26/07. 

Please amend claim 33 of the previous examiners amendment submitted on 
3/16/2007 as follows. The examiner made a mistake in the previous amendment. 
Specifically, the examiner failed to include "means for" prior to steps (a)-(g) of 
independent claim 33. Please see the amendment below. 



33. (Amended) An apparatus for enhancing facial images of a person in a video by 
superimposing virtual object images onto said facial images automatically and 
dynamically in real-time, comprising the following steps of: 

(a) means for capturing a plurality of images for said person with at least one means for 
capturing images, 

(b) means for processing said plurality of images in order to detect the face of said 
person in said plurality of images for an initial face detection, 

(c) means for tracking the detected face in real-time using a face tracking window, 

(d) means for verifying said face within the boundary of the face tracking window using 
a second local face detection, 

(e) means for calculating facial feature coordinate information from said face by 
applying a plurality of facial feature detection approaches and applying a block- 
processing, 

(f) means for processing a touch-free interaction by said person to select virtual object 
images, and 

(g) means for superimposing said virtual object images onto said facial images 
automatically and dynamically in real-time, 

wherein the virtual object images comprise predefined virtual objects that can be 
attached to and enhance the facial images, 
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whereby the verification of said face within the boundary of the face tracking window 
makes more accurate facial images to be passed on to the next step while enabling 
real-time tracking of the face, and 

whereby said touch-free interaction enables said person to choose said virtual object 
images on a means for displaying output to superimpose onto said facial images without 
touching any device. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hadi Akhavannik whose telephone number is 571-272- 
8622. The examiner can normally be reached on 10:30-7:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Mancuso can be reached on (571)272-7695. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



HA 
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